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Action Languages 

a report of the year's research 
to the National Aeronautics and Space Administration 
Marshall Space Flight Center 


Dan Hays, PhD, Task Leader 
Gordon Streeter, Associate 
The University of Alabama In Huntsville 


I. Introduction 


1. Research Goals and Scope 

This document reports an investigation of what we have chosen to call 
action languages, the means of communicating about behavior In situations. 
During this project we were especially concerned with the ■behavior" or 
events associated with mechanical or electronic devices. The basic 
concepts are more general. Action languages could refer to the behaviors of 
animate creatures as well as machines. Indeed, even for device-action 
languages, though we often Imagine a person telling the machine what to do 
and the machine silently and eagerly complying, a more workable 
arrangement would also Involve communication from the device to the 
person, in the nature of feedback, requests for human Intervention, and so 
on. 


A related topic examined during the year was capabilities of present- 
day object-oriented computer languages In a sense, the message-passing 
schemes of object-oriented programming systems (conventionally 
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abbreviated as OOPS) constitute one kind of action language, though 
operating just .within computational devices. Further, the OOPS provides 
one model for action languages In general In that real actors can be viewed 
as “objects’ that pass messages with the intention of generating actions. 
Besides this, we wanted to examine existing object-oriented systems for 
adequacy. In particular we were Interested In the question of discretionary 
response to the “messages’. Present-day “objects’. It turns out, even when 
they are called “actors’ or “agents’ 1 are not usually set up for 
discretion, though It may be possible to program them to evaluate what they 
are requested to do before they do It. 

Theoretically, action languages could be designed for both simple uses 
and more extensive or complex ones. As some of the discussion will 
suggest, even simple cases can become fairly complex when the realities of 
action situations are taken Into account. In other cases, such as that of the 
so-called Command and Control Languages, communication conventions 
sometimes seem to have been simplified to fit a lean view of situations. By 
focussing on communication about action, and the situations In which 
actions occur, we would like to call attention to practical requirements for 
adequate Information exchange. 

The subject matter of the research has thus been fairly basic. It was 
also deliberately programmatic. This year's work was cast as the first of 
three years of ever more specific exploration of the action language 
concepts. So, the Ideas presented In this document are In a sense 
preliminary to more specific development that as It turns out might be 
pursued at some other time, In a different context. 

During this year, certain basic Issues.of action-related languages were 
raised. In addition, attention was given to the kinds of situations that 

1 See Tello ( 1 989), Chapter 9; Hewitt ( 1 977), Hewitt and DeJong ( 1 983). 
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Space-resident devices might perform in. This material suggests some of 
the complexity of the design Issues that may well be Involved for human- 
machine and machine-machine communication, If one accepts the principle 
strongly urged here that languages for machine communication should 
usually Include facilities for describing environmental features and 
dynamics, as well as 'blind' machine movements. 

2. Research Funding 

The Action Language task was one of several Included In a Cooperative 
Agreement between the National Aeronautic and Space Administration’s 
Marshall Space Flight Center and The University of Alabama In Huntsville. 
The title of the larger project Is "Foundations of Automated Software 
Techniques". This research Is listed as Task IV of the agreement. 

3. Personnel 

Dan Hays, PhD, served as Task Leader. He Is Associate Professor of 
Psychology and a researcher at the Johnson Research Center of the 
University of Alabama In Huntsville. Mr. Gordon Streeter served as research 
associate, technically a Consultant, on the project. 

Though discussion of various Issues has been shared, Hays has been 
primarily concerned with the conceptual analysis of situated action 
languages, and Streeter with evaluation of object-oriented computer 
systems. 

The role of various people at UAH who are concerned with research on 
artificial Intelligence and knowledge systems Is also acknowledged. 
Particularly helpful was discussion with students from various states who 
participated in a summer program funded by the National Science Foundation 
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of which Hays was Project Director. This program was titled "Knowledge 
Organization for Machine Systems’. The summer of 1988 was the second 
time that It was held. 

The role of the Johnson Research Center of UAH must also be 
acknowledged, both for Its specific role In this research and also for having 
supported the development of. machine Intelligence work as an 
Interdisciplinary pursuit at the university. 

During the early months of the project the energetic participation of Mr. 
John Wolfsberger, then still a Marshall Space Flight Center employee, Is 
gratefully noted. He was very helpful In making explicit the kinds of 
existing problems and potential applications that Inquiry Into device action 
and language systems might Impact. These discussions often centered on 
the production and coordination of software-especlally software for the 
testing of complex devices. 

For the Cooperative Agreement which funded the research reported here, 
Donnie Ford was Principal Investigator at UAH during the first months. Jim 
McKee assumed these duties during the latter part of the project year 
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II. Overview 


This report covers these main topics: 

• characteristics of action languages, Including major dimensions 
and relation to situations, 

• an evaiuation of current object-oriented computer ianguages, 
especially for their capability to handle discretionary actions, 

• summary comments. 

During the course of the report, various sample action ianguages, or 
parts of them, will be considered, to help tie the discussion to concrete 
problems. 

Because of the fairly basic nature of this research, we were concerned 
more with working out conceptual Issues-and simply coming up with the 
Ideas that would be Involved In working with action languages and 
extensions to object-oriented computer programming systems-than with 
the development of applications. However, It should be noted that sample 
computer code Is Included In the discussion of object-oriented languages. 
Besides Illustrating points of the report, It Is meant to suggest what code 
might look like for later development. 
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III. Action Languages 


1. Goals 

The involvement of language in action Is the major concern of this of 
this project. Just how communicated signals can be Interpreted and related 
to activities that accomplish something, Is the basic question that has been 
explored. The focus has been Intentionally broad, so as not to obscure 
Issues that may be important in the design of realistic action systems. 

Sometimes the language-action relation is fairly straightforward, at 
least in principle, for example where predetermined signals are supposed to 
trigger planned events In relatively static systems. Other cases may 
Introduce considerable complexity In that they Involve discretion in the 
interpretation of information Again, certain tactics of communication 
need to take into account that situations can change quickly, so that the 
communication must be sensitive to local conditions. In these cases, 
Information and decision-making are often decentralized In such 
situations, to be sure, some of the parts or participants may behave In a 
simple way or have only limited ability to “think" about what they are 
doing. The situation Itself though may be complex In terms of actual events, 
or-more critically— In terms of the possibilities that must be considered by 
the system designer. 

Providing conceptual analysis of the situations of language use Is the 
task at hand. The analysis reported here centers on 

> dimensions of 'action languages’, with special attention to 

> the way that effects occur In action systems. 
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Always In the background Is the question of desiderata for programming 
systems and other arrangements that would allow useful and Informative 
communication In action situations. 

2. Language and Action 

An action language Is one that directs or modifies the performance of 
actions in environments Specifically Included would be not just 
directives, but also background Information and descriptive messages that 
could at some time be relevant to actions. 

The definition Is Intentionally broad. It allows Inclusion of languages 
that tightly direct performance, such as ordinary programming languages for 
computers, conventions for “command and control" situations, robot 
languages at various levels of specificity, and so on. Languages with less 
direct relations between what Is said and what Is done are also Included, 
such as specification-based computer languages or ordinary human 
languages such as English. 

Engl I sh-or Japanese, Russian, Hausa, etc -do a lot more than just 
referring to action and directing It. Present computer languages do a good 
deal less, except when dealing with the exact devices and very restricted 
situations that they have been developed for. 

Goals. Though the span of linguistic and situational Interest has been 
kept broad, since a basic understanding of language-action relations Is being 
sought, the real concern of this part of the project Is with action languages 
that are specific enough to apply to capable machines in their interactions 
with one another and with human beings. 
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Underlying the general concern for the language- act ion relation 
expressed here are the more concrete but difficult goals of designing 
language conventions that are adequate to the next generation of smarter, 
more capable and mobile machines. 2 The language conventions for capable 
devices probably also have to allow for informative communication with 
their human users, though cases can be Imagined where machines are 
Interacting In situations so remote that ready communication with humans 
would be beside the point. 

The examination of capabilities of object-oriented programming systems 
(OOPS) for current computing machines, reported In a subsequent section, Is 
germane to the Issue of easy communication means and manageable 
programming. Of software technologies currently available, object-oriented 
techniques seem to offer the kind of modularity and referential capabilities 
that might serve as the basis for more complicated systems. 3 

Another area which can be treated linguistically, In a certain reduced 
way, Is that of intra-device communication, where parts are given a 
rudimentary ability to detect certain conditions (e.g., pressure, abutment) 
and to communicate appropriately about them. 

The conceptual Inquiry Is seen as necessary In developing some of the 
concepts that wit/ be helpful in planning communication conventions for 
devices and people that interact In situations of physical action. 

The language-action relation Is a broad and complex one. Some Important 
topics Involved In It are: 

a. dimensions of action-oriented languages, 

2 Good action language conventions and capabilities for existing devices would be useful also. 

3 Though today’s object-oriented languages could stand some development, as we discuss 
elsewhere. 
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b. the kinds of actions that machines might be Involved In, 

c. situational aspects of action and action communication, 

d. the effects of actions, 

e. human needs and biases In communicating with machines. 

3. Dimensions of Action Languages 

A language Is a set of signs that have some meaning or reference. “Set" 
may be too sparse a term, since the signs used In a language generally have 
an Identity as belonging to the language, and some kind of restrictions on 
contexts of usage. 

In this discussion, the viewpoint of general semiotic theory Is taken. 
This field discusses sign systems of many sorts, not just ones of ordinary 
human verbal language but also the languages of signs, clues, symptoms, and 
so on In various media. 

The coherence or belongingness that we sense In the parts of a certain 
language (whether It Is the set of conventions that we use to prove 
theorems In an algebra, or the “language of flowers") seems to have to do 
with the organizing properties of the system of interpretation of the 
language. This Is the set of rules, or perhaps procedures, that allow those 
familiar with the language to discern the patterning of signals (syntax) and 
to relate the signals to meaning (semantics or pragmatics). 

Ordinarily we think of the ‘signal’ part of signs 4 as being separate 
from what Is being referred to, and as arbitrary. In ordinary discussion, for 

4 In semiotic theory, the term "sign” usually refers to the complex of signal and referent or 
Interpretation, and Is distinguished from signal or physical carrier of the language’s messages. 
However, because of ordinary English usage of the term, “sign” Is sometimes used to focus on the 
language token or figure apart from Its reference. The theoretical distinction should not be 
troublesome at the level of discussion of this report. 
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example, we speak of symbols as being Items that have in some abstract 
way come to refer to something special. This Is the case for much of spoken 
or written human language, where sounds of a certain pattern bear no 
Intrinsic relation to what Is being talked about. But not all signs are so 
abstract. Certain signs, called Icons by semlotlclans, are similar In some 
way to their referents. Graphic gestures and road signs are often Iconic. 
Another class of signs, called Indexes or indices In the Jargon of semiotic 
theory, are more closely Involved with what they are referring to. A 
symptom (whether of a common cold, or a healthy economy) Is a kind of 
Index. The signs of nature, which are themselves part of nature, are 
'Indexlcal' In semiotic terminology. Note that an Indextcal sign depends on 
an Interpretive system for both determination of meaning and 
communication. For example, the same crack In a structure of rocks may be 
seen by a geologist and a lay person, but probably only the geologist Is onto 
the system of interpretation that gives the meaning and implications of the 
fault Indicator. Indexlcal processing Is especially relevant to action 
languages, as developed here, because of the Important role of perceived 
ongoing action. 

Language and Action Languages that deal with action may be capable of 
one or more of the following kinds of functions, though some languages are 
probably more tailored for just some of the following. A fully capable 
action language should handle all of the following. One can distinguish 
among: 

- descriptions of action, perhaps also Including related causal 
explanations for what Is done; 

- directives for action, that with some degree of forcefulness 
suggest, channel, command, or even coerce behavior; 
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- ongoing concomitants or modifiers of action, communications that 
are closely integrated Into the behavior. 

- discussions of action among potential participants, advisers and 
directors, either In advance for planning, or retrospectively, to evaluate 
what has been done. 

Biases of language definition and focus. Though all of these seem quite 
naturally related to action, and desirable to have in a language, It seems 
fairly common for people to focus primarily on Just one. 

We mention this here since It Is common for people to think of 
"language* In restricted ways. We are arguing for some breadth In the 
application of the term to action situations. 

One bias often found among scholars, and possibly even In the whole 
tradition of Western academic thinking, Is to be concerned primarily with 
descriptions and associated explanations, evaluations, and so on. (There 
may even be a tendency among academics, from Plato on, to shy away from 
action descriptions in favor of more abstract terminology of qualities, 
virtues, tendencies, essences, and so on.) 

By contrast, most computational work relating to action systems (e.g., 
manufacturing, military, or transportation devices) concentrate heavily on 
directives for action, with descriptive material playing at best a secondary 
role. The same bias may be seen In managers and engineers. Plans for 
action, especially of machine systems, are often so concretely determined, 

In detail, that they are virtually Identical to strings of commands, with 
specifically planned contingencies. 
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Action agents may in some cases care little for description and 
explanation, or yet again for close direction, but will be Involved in the 
initiation and ongoing modification of behavior In real situations. Action 
becomes real for the actor, and the perhaps unexpected contingencies of the 
environment are not only real but may be surprising. For many agents, of 
course, the description or explanation of Intended behavior may be critically 
important. It is probably a good principle that the more Intelligent and 
autonomous the actor, the more that descriptions will be relied on, 
especially In communication with others who are concerned with the 
behavior. 

Various groups may be concerned with plotting future action or with 
retrospective analysis of behavior that they or others did. Often, this Is 
regarded as background or workshop activity, outside of the main arena 
where action occurs. 

It Is the heavy focus on minutely planned, specific directives for action, 
so widely found as an assumption and practice In the technical and 
managerial fields when planning for action systems Involving devices 5 , 
that we believe needs close examination and challenge. Action Itself Is 
always specific, whether specifically planned or not. But, detailed external 
specification of behavior may not always be a feasible approach. This Is 
true both of descriptions and directives, which may be similar In some 
cases. 

A. Behavior of Ambulatory Devices 

Consider what a capable machine might be expected to do in a remote 
environment, or one not so remote, and what it might need to process In 

5 Or, for that matter, involving the actions of people. One might compare the detailed protocols 
prepared for the actions of Mission Specialists on Shuttle missions, for a striking example of 
detailed directives for behavior. 
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order to function adequately. 


Various devices of Interest to the Space program might be expected to: 

/. Successfully maneuver over ground or in some fluid medium. 

Such locomotion In any medium 

- requires the processing of various subtasks, 

- requires orientation to environmental patterns, 

- requires matching of environment to directives or other goals 

- may require attaching to and coordinating locomotion with other 
devices or a matrix device 

2. Relative to objects or devices treated as unintelligent, the capable 
device might have to 

- plug Into and dump electronic readings, or send probe signals, 

- stabilize, 

- adjust knobs or other settings, 

- remove fasteners, 

- check connections, 

- jostle, 

- sense state nonelectronlcally (by processing patterns of sound, 
vibration, color, position, etc.), 

- secure to an environmental holder, 

- secure to transportation device (Including seif), 

- transport (see comments on locomotion above), 

- other conceivable kinds of action. 

J Coordination of actions with other similar action-devices might also be 
required. This could Involve: 
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- locomotion: 

- co-orlentatlon, 

- assistance In travel, 

- one moving, one watching, etc.; 

- working on an object or device: 

- one stabilizing, one operating, 

-joint action on object or device; 

-assistance In self maintenance or repair. 

4 Relative to environmental features or regions the device might have to 

- sense and scan, 

- rearrange the environment, by 

- digging, 

- boring, 

- moving separable parts of environment Into configurations, 

- adding and arranging parts brought In. 

(See also locomotion (rearranging self relative to the rest of the 
environment.) 

5. Relative to other intelligent devices (see also, humans) the device might 
need to 

- Identify them, 

- report Information to some of them 

- re environmental standing features, 

- re environmental transitory features, 

- re environmental possible features, 

- re state of self, 

- re organizational superstructure, 

- re tasks directed elsewhere or Judged to be desirable; 

- request or direct other action, 

- request or direct coordinated action, 
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- assess cognitive state of the other devices In making judgements 

about the feasibility of Interaction 

6. Ordinary computation might also be required. The dev I ce m 1 ght 

- calculate or compute abstract Information, 

- serve as ordinary storage-retrieval device for factual databases, 

- and so on. 

Processing Required for Action. For the kinds of ambulatory devices 
that one might wish to have, the processing requirements are certainly 
formidable, though considerable work Is being done In many laboratories to 
work out procedures and understandings necessary to build such devices. 6 

At a generic level, the following kinds of things would be required: 

The machine has to have adequate Input reflecting the state of the 
environment In order to get around. 

The actions of the machine have to be adaptive to local conditions, 
Including unanticipated or unremembered small details. 

Generally useful programs for doing things like locomotion In the usual 
medium should be readily available to the device or device system. These 
should function concurrently but In some kind of communication with some 
of the other processing, but work reliably at a very deep level of the system 

At the same time that these generally useful programs are In operation, 
together with associated memory/knowledge operations, the device has to 
be able to access 

6 Or , to build them better , since ambulatory devices, and various capable stationary devices 
already exist that do some of the things mentioned, at some level of competence. 
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- a variety of cue-patterns that, If detected or approximately detected, 
could either be 

- stored away as Information about the scene, or 

- used for Immediate replanning of ongoing actions. 

- computation that assesses when a certain level of problems In carrying 
out actions means that reevaluation of more molar actions must be done 

- ordinary, ongoing attention to energy levels, resources, etc. 

- possibly, attention to coordination of action with other units. 

If a machine Is walking (or swimming, flying, or being propelled) 
someplace, It needs to have a stock of small component plans for getting 
around obstacles, adjusting to buffeting or signs of danger, and so on. 
Perhaps more Importantly, It needs major adjustable locomotion and 
maneuvering capability. Some of the plans for exceptions or auxiliary 
activities could feed Into the locomotion/guidance 'engine' from separately 
computed sources within the device. The question of how to balance motive 
control/adjustment computation distribution and Input from exteroceptors 
or external sensory systems, planning referents, and other processing of 
distal information Is certainly an Interesting one. 

If the machine Is braced someplace, fixing something, It needs a 
somewhat different mix of activity. Needed will be: 

- computation to maintain its braced position (or to counterbalance 
moves with propulsion or some such), 

- adjustable movement computation, communicating heavily with the 
brace/stability computation, for Its efforts In manipulating things, 

- superordinate task planning and execution routines which themselves 
have backup heuristics (e.g. If a bolt sticks) and ongoing sensitivity to 
things that are noticed while performing the maintenance, 

- possible communication with other devices 

- working with It, or 
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- In a supervisory or Informational position; 

- ongoing but occasional abstraction and storage of Information about 
what It encounters In working on the task, or notices Incidentally. 

The above Implies a very large amount of computation, as well as 
sensory capability and control mechanisms for movements. Perhaps some of 
the functions could be Integrated Into the major computation and control for 
basic activity, though multiple computation centers, perhaps heavily 
distributed ones within the device, may be required. 

Effectors and perceptual arrangements require essentially continuous 
attention at some level. Other computation could be more occasional, for 
example to evaluate overall task progress. 

Additionally taking Into account signals from other sources, and 
generation and giving these signals for coordinated action, adds further 
challenges to the design. Yet, coordinated action would certainly be 
desirable In many cases. 

Thus, the rather complex computation for action In a situation Is a 
major context into which an action-related language must be embedded 
The sending and receiving of signs, their Interpretation, and possible 
subsequent behavior adjustment, must fit smoothly Into the computational 
complex of the action devices which are participating in the Interaction. 7 

More Modest Devices To bul Id capable ambulatory robots and to design 
procedures for making them work smoothly and effectively are real goals 
for many people. More restricted devices may also participate In action 
related signal evaluation. 


7 Or possibly, those that are observing the action scene and evaluating It. 
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Mentioned above was the possibility of designing small “languages’ for 
parts and subassemblies of larger structures. 

These would Involve such structural features as 

1. Partitioning of certain physical parameters, perhaps by mechanical 
means, into a small set of values, each with an associated symbol or value 
within a syntactic category; 

2. A typology of kinds of states relevant at the “part’ level. 

Dichotomous or small-valued discrete symbols could probably handle much 
of what would be needed: a ternary logic would seem to provide a lot of 
structure. Such features as abutment/nonabutment, attachment/ 
disattachment, valve closed/possibly open/open, acceptable level/marginal 
level/unacceptable level of v, stored/discharged/uncertain, whole/severed, 
and so on. 

3. Patterns of features could form a small corpus of potential sentences 
processed locally, which would then map into transmission states. 8 

4. Connectedness operators, or some such, could mediate local, and 
eventually more extensive communication. Such communication could be 
initiated externally (as in polling or external Imposition of interpretation) 
or from certain conditions at local levels. 

Other kinds of devices, and device communication arrangements might be 
analyzed. For example, it is a very common pattern to set up a kind of 
reduced language relating a small set of discrete signals to device events 
Such languages would probably have a minimal syntax, e.g., unitary 
commands strung out with constraints dictated by actions taken rather than 

9 One images both local processing, and even local means of processing (what was referred to in 
an earlier report as a local logic ). 
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linguistic structures or contextual sensitivities. The sign-act linkage may 
be done routinely, with selection dependent on pre-wlred state-sensing or 
other determination, as In various automated manufacturing situations; or 
with Interpretation 'modules’ involving human consideration, as In some of 
the spectacular long-distance device control missions of the American 
Space effort. 

Often In these token -> preset action sequences there Is a one-sidedness 
of control, as well as a kind of event conceptualization that forces 
predicting a presumably exhaustive tableau of scenarios within the scope 
of activity of the device and Its often simplified environment. Such careful 
engineering Is often essential, since little real Intelligence Is built Into the 
machines (though their form may reflect real Ingenuity In design), and costs 
of failure are very high. 

In more fluid situations, however, or ones where remoteness or danger 
precludes human mediation, the action structure needs to be more 
differentiated, and more evaluation needs to be made In the situation. 
Chances are good that such evaluations will not be directly related to 
actions, but will need some kind of structure, perhaps at about the level of 
an “expert advice system". 9 to approach the problems well. 

5- Language Characteristics: Some Issues 

One of the problems In conceptualizing action-oriented signaling 
systems Involving devices Is that there are many kinds of devices. 

Generally, we build machines to solve certain kinds of problems, though 
we may later discover that the machine or tool also can be applied to other 

9 Increasingly familiar as a fairly straightforward way of representing the evaluation of input 
for decision-making and initiating search for more adequate information when needed. 
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problems that we did not think of In the first place. 

, Machines that we make tend to be special ized-even computing machines, 
which have a reputation for generality— and they vary greatly In complexity. 

So, the extent and nature of a language for machine action will depend 
on the greatly variable nature of machines. 

Indeed, we should design the machines with communication systems in 
mind. 

This means that some devices will have very restricted signaling, 
perhaps only serving as Indexlcal signs for sentient systems such as humans 
or observing robots. Other devices may have a very ‘mechanical " appearing 
set of state tokens to communicate about. Still others must be designed 
with substantial ability to perceive and evaluate dynamically changing 
situations. 

It is difficult to say that a sensor has real understanding of a situation, 
but it would be difficult not to aim for good “understanding" by a capable 
ambulatory device that Is intended to respond to relatively novel events. 

For such capable devices, it seems clear that 

Understanding is more basic than linguistic communication. 

By “understanding" Is meant here a kind of “action knowledge", or ability 
to respond In a sensitive way to changing situations. 

In such cases, the Interpretation and evaluation of messages from others 
would be just part of the interpretation and evaluation of information in 
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the situation of action. 


6. Effects 

Traditionally analysts been heavily Interested In causes. This seems 
generally true of a fair amount of philosophic Inquiry and much other 
academic discussion. It Is a clear characteristic of scientific Inquiry, and 
Is pervasive In applied fields of diagnosis of problems of built systems. 

The study of action languages leads to a concern for effects. Perhaps 
this Is the reason that they lend themselves readily to talk of the design and 
Implementation of systems. “Action communication engineering”, 
concerned like most other sorts of engineering 10 with effects 

In this section, the structure of effects will be discussed somewhat 
briefly. If causes are sometimes tricky to tease out and verify, effects are 
often widespread and unwieldy to trace, especially If secondary effects or 
side effects are examined. 

Relative both to causes and effects, the conceptual focus of the analyst 
seems very Important. One Investigator may, for example, only be looking 
for certain kinds of causes, labeling the others as extraneous to an 
Investigation. Similarly, a person may be looking only for certain kinds of 
effects. Whether or not one should limit one’s view of effects Is debatable, 
especially for potentially dangerous systems. 


10 The term “engineering” Is used In a broad semantic sense, and should not be taken as Implying 
something taught In engineering sch ools. Besides concern for effects, engineering Is also of course 
concerned with causes-lt Is difficult to be concerned for one without thinkg of the other. But the 
difference of focus on cause versus effect is not trivial, It seems. 
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Factors Important to Effects. Various factors would have to be 
examined In characterizing various effects. These Include: 

- Locus a given effect, both Its initial locus (if appropriate) and 
subsequent identifiable loci of changes. 

- Timing of the effect. This could simply be 

- when It occurs, In a point sense, or 

- sequenced effects, 

- temporally facilitated effects, Including levered effects and 

buildups, 

- other temporal relations. 

Nature of the change, whether to material, covering, connectedness, etc. 
Note that the effects of some events is to halt or Impede change, however. 

Simple effects, versus articulated or component effects (could depend on 
nature of what Is being affected). 

The cases of effects on a moving system, or on a system already In some 
process of change, seem especially difficult to conceptualize. 

There may also be non-focal effects, that Is on objects or environmental 
parts that are not of primary Interest, but that might be useful to know 
about at some time. For example, If a rocket Is fired toward a destination 
point, changes may be made In the atmosphere that it passes through that 
could matter In some way. 

In this connection, the solidity versus diffuseness of effects Is 
Interesting. 
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Action Granularity The “granularity" of action, a metaphor, has to do 
with the fineness of detail, either In a physical or a systematic sense, and 
relates to just how an action can be effective. 

To some extent, granularity may Just be a choice of the analysis, but 
there could be a kind of effective granularity, reflecting at what level of a 
system the organizing effects actually come from. 

Finer distinctions of action type need to be added to flesh out the 
concept. For example, one could simply analyze fineness of detail of action 
and effect. But If one also says what kind of action Is Involved, more 
Information Is given. 

7. Communicating about Effects 

In an action situation, It Is usually effects that we are concerned with, 
though we may sometimes be concerned with propriety (even apart from the 
effects of being proper or not). 

In an action language, communications may be aimed at 

• Identifying worthwhile effects, so they may be sought, 

• identifying negative effects, so they may be avoided or neutralized, 

• examining effects to determine their nature, 

• exploring, advising, or urging actions that would lead to effects. 

There are variations on these, such as participating In action patterns 
designed to limit damaging effects. 

A major distinction relating to communicating Is when it is done 
relative to a given action It will make a difference both In aptness and In 
form of communication whether the message Is delivered well In advance of 
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the action, as a kind of plan, or is delivered In mid-action. The message may 
be late, or could be a post-action evaluation, also. 

An interesting feature of action languages is that the processing 
demands of the situation of reception, and possibly of transmission, may 
affect the form of the action-related message. For example, more leisurely 
descriptions can be discussed In advance on an action, or thereafter, though 
length may be tedious (In less human terms, cause processor overload) In 
any case. In the heat of fast-moving action, a message will have to be terse 
at best. 

8. Talking. Doing, and Shoving 

By now, enough options for behavior and possible dimensions of 
situations have been introduced to suggest that, if action languages 
themselves might not be too complex, at least the choices made In 
restricting them may be difficult. 

Even so, communication conventions for the behavior of devices are 
currently pretty simple from a structural point of view, If we consider 
external actions of machines. (Computational devices per se have complex 
languages, though little Is left to the discretion of the computers In many 
cases.) 

Present-day robotic devices are almost always involved In 
communications loops, but the communications Involved are formally fairly 
simple. This is true because even now most such devices are treated as 
blind machines, that is systems that can move Is some limited space. 

Relation of the movements to things Is often unspecified, though as the 
technology of force-sensing and other sensory coordination Improves, 
environmental references In the robotic languages should also be expanded. 

But this Is a problem, because of what seems to be a blindness bias In 
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the field. The situations In which most Industrial robots operate Is of 
course quite constrained. So that If a part to be worked on Is In place, the 
coordination of the part’s locations and the robot’s locations can practically 
be a responsibility of the matrix system, e.g., the assembly line 
arrangement, with only minimal sensory information from the robotic 
device Itself (In many cases there Is none at all). 

An action-specifying language for a blind device Is not necessarily a 
simple language. Technically, If movement within a restricted space can be 
ordered up and these movements have real-valued coordinates, an unlimited 
number of actual patterns of behavior can be generated by the system. 1 1 
The effects, though, may depend on what Is In the environment. Nothing 
might happen, or harmful and unplanned events could take place, depending 
on what else Is there besides the machine, whether environmental entitles 
are flexible or rigid, sentient, etc. So, an Infinitely large set of behaviors 
(movements) could ensue, and none of them would Involve any sensitivity to 
the environment. 

It Is difficult both to describe the environment and further to coordinate 
action with environmental knowledge (or supposition). But this Is 
necessary. What may also be necessary before machine communication 
conventions advance very far Is to design machines for somewhat higher 
level computation, and a bit more autonomy. 

As an example of approaches to robotic languages, consider the reports 
in the volume edited by Ulrich Rembold and Klaus HOrmann, Languages for 
Sensor-Based Control in Robotics ( 1 987). Only a small number of these 
papers exhibit anything that looks like a language, and these are fairly 
simple (start, stop, moveO, grasp). The papers are primarily concerned 
with procedures for Integrating sensory Information, or the details of the 
math Involved In the control of the effectors. Though to speak of “language" 
has a certain currency, the matters addressed In that volume, and In many 

1 1 This Is reminiscent of the capability of languages to generate indefinitely large numbers of 
sentences. 
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other places, do not have much to do with linguistic possibility or 
necessity, but with the mechanical or mathematical background that would 
be referred to or that would be assumed by a system of communication. 

9. Talking to Machines 

In considering the means of communication with a device several 
questions are Important: 

What needs to be communicated? 

How would we like to communicate with our devices? 

And, what do our devices need to tell us? 

The answers to these questions are practical ones, and may be particular 
to situations. But the questions are not always asked. Frequently, the 
communicative aspects of machines are not specifically designed (though 
the sensitive designer will certainly consider this aspect). We think of 
machines as doing, not so much giving Information. But devices In action 
always give off some kind of slgnals-not necessarily the most Informative 
ones. Other devices are designed specially to give limited messages, In a 
message-leaving place. At other times we do not need direct 
communication with a system, In the sense of messages exchanged and 
Interpreted by both parties. We can get all the Information we need Just by 
observing the machine In action. 12 

The same could be true of a sufficiently sensitive and Intelligent device 
In Its relations with people (or other devices). Just as we guide much of our 
own motor action by observing what Is happening, rather than because of 
detailed verbal directive, a sufficiently adept machine should rely very 
much on ongoing situational understanding. In such a case, communications 
would only be part of a larger scene of action, and processed along with the 
other sources of Information. 

12 In semiotic theory this Is considered to be meaningful but unintentional communication. A 
major class of signs called Indexes are involved. An index Is a kind of natural sign , such as an 
event of nature, a symptom , or a clue. The system of Interpretation Is Imposed by the observer , 
but the causation of the sign Is not in general assumed to Involve volition. 

Action Languages - a Year's Research. D. Hays & G. Streeter 
U. Alabama In Huntsville. August 1989. p. 26 



Related design decisions Involve how much we want to be automated, and 
how much we want to be passive, how much of a system we want to be 
sensitive, and how much should be structurally useful but stupid. 

There may certainly be tradeoffs between having parts that are sensitive 
and parts that are structurally sound In a mechanical sense. Further, If 
there Is one glaring fact about many sensors It Is that they may be 
unreliable. 

Despite the bias of at least the senior author that robotic devices should 
be massively sensitive, and as cognizant of their spheres of action as their 
resources can allow, many successful robotic operations today are blind, 
tightly controlled, dependent on close environmental structuring, and so on. 
These are all design cholces-though It seems that In the world of robotic 
design, the side of blindness and external control has been much more 
explored than have possibilities for semlautonomous and sensitive action 
devices. 

How we would like to communicate. If we take seriously the second of 
the above questions (how would we like to communicate with machines), we 
will probably find that we want to communicate less rather than more, and 
that we would like for our machines to understand what we want to know 
about or for them to do without detailed explanation. Of course, we want 
them to carry out actions compliantly and competently. 

Suppose we have a system with several valves which permit or block the 
flow of fluids. What kind of Valve Language would we like to have, to 
communicate Important things to the system? 

The simplest case Involves no automation. We Just observe whether or 
not a valve Is open or shut, or partially so, using Indexlcal signs: the 
position of a handle, the sound of the fluid In the neighborhood of the valve 
or Its connected tubing, etc. If we can physically open and close the valves, 
we are giving a kind of pragmatically effective "signal’, In a certain 
sense. 13 
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In the next most complex case, there exists some way that we can get 
Information about the state of the valve, or the fluid flow In Its 
neighborhood. In monitored systems, such Information Is Important, 
whether or not there are remote means of opening or closing the valves. 

We can get signals purporting to give Information on valve state (say, 
closed, open, partially open, or some finer gradation) from various kinds of 
proximal sensors, or from Inference made from slightly remote sources. (If 
the fluid got here, that valve must be open.) If there Is a sensor or sensor 
combination that can be treated as a unit at the valve site, It will respond 
with one of several signals Indicating Its state of openness. It may 
volunteer the Information, or be asked. If we, or a supervisory unit, wants 
to know about the state of the valve, a question can be asked: Are you open 
or not? 

We might also want to know such things as: Are you open, and Is any 
fluid passing through? What Is the rate of flow (temperature, etc.)? 

At a perhaps more subtle level, we may really want to ask the valve: Are 
you all right? Are you lying to me? Have you been damaged (hung up, etc.)? 
These questions require either more sensory Information, or a more complex 
system that can make Inferences about the valve. If the system Is more 
complex, we probably just want an answer, though we would wish to query 
It concerning the Information that It Is basing its inferences on. If we are 
In a hurry, and If we trust the Inference system, the higher level of 
abstraction will probably be preferred. 

In discussing matters with machines, higher levels of abstraction In the 
semantics of our discussion always Imply arrangements of somewhat 
complex Inference by the machine or Its Immediate monitoring units. For 

1 3 The sense Is this: to the non-sentlent system , the movement In not a completed sign , though it 
is a complete sign (with interpretation and actualization) to us and to others who may observe us 
turning the valve.. If the plumbing were sentient, for example by having sensors and a 
computational unit suitably programmed, the same behavior would be not Just effective, but would 
also have informational value to that system also. 
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example, what we may want to ask the machine Is really something like: 

Are all those valves shut? Or: are the valves open Just the way they should 
be under the circumstances? If things are not as expected (whatever that 
Is), then we may want to make finer-grained Inquiries, say at the single 
valve-sensor level. 

Similarly, the system may gain our attention only If certain 
configurations of the valves exist, or If Indicators elsewhere suggest a 
problem. In either case, a fair amount of knowledge, and dynamic relating of 
machine states to Inferences about Intended goals, will be Involved. 

The cognitive reJata of a Valve Language, then, could Involve a 
knowledge base, and could accumulate experience. The patterns, and goals, 
can be complex and delicate. (People working with Space systems are 
keenly aware of the complexities of systems of valves, some Earth-based, 
some that fly.) The problems of sensor reliability, fine timing decisions, 
and so on, are real enough. 14 

Real systems of valves, of course, have different patterns of 
communication depending on their state of development. A human will ask 
different kinds of questions of the device when It Is being checked out In 
the testing lab, than when It Is functioning In Its Intended mission. For one 
thing, mission behavior may be very rapidly timed, or take place In remote 
locations, so that In moving from design and test phases to operational 
phases, there Is a general shift from detailed human communication with 
small parts of a system, to Internal-system communication among the 
various sensors, Inference and control units, and related devices. 

It Is Interesting that Valve Language, as discussed here, may not need to 
refer to the external environment. However, the local, device-internal 
environment must at least Implicitly be handled In the computations that 
Involve Inference based on Information from more than one Internal position. 

Information and Action When the valves are turned on and off by 
14 Valve-heavy systems are Important elsewhere, for example In the power Industry. 
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remote means (certainly the case for the more complex systems of the 
above examples), action statements will be transmitted. Just as there are 
levels of abstraction In queries about the state of parts, subassemblies, or 
total devices, there are levels of abstraction in imperatives for action 

That Is, each valve turner (or whatever part) could be addressed 
Individually. But the human may not want to do this, or may not be able to 
because of the necessity for rapid or coordinated action of parts and units. 

So, the human, or possibly a high level control device, will Issue an 
action statement whose meaning has been set up to Involve a certain 
pattern, perhaps even a pattern Involving locally computed contingencies. 

The higher level action statement Is often just In the form of a 
specialized releaser, that Is, It says “Do It nowl“, where 'It' has been 
specially set up. 15 

In other cases, high level directive to a machine may give more 
information about choices. For example, most sorts of directions that we 
Imagine giving to ambulatory robots are of this kind. 

Distal Languages and Contact Communication. A contrasting situation 
for communication with devices could Involve what might be called a Nudge 
and Push Language. 

As humans, we rely on spoken and written communication very heavily. 
Both visual and auditory senses are distal. Sometimes we do use closer 
means of communication with one another, and we may also do this with 
machines. 

For example, suppose that a Space worker has one or more robotic 
assistants to help him or her do repairs In EVA. Such small devices may 
need to be shown what to hold 16 , what to work on with a tool, how to 

16 We distinguish between releasers and specifiers In an action language. There are also 
qualifiers. 

16 Clamping, bracing, countermovlng, and other stabilizing functions should be Important for 
such semi-intelligent helpers. Consider how much such supportive functions are Involved In 
ordinary shop work. 
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move the tool, and so on, The "showing", really a matter of nudging and 
Illustrating by having the robot go Into a semi-passive, semi-limp motor 
learning state, and being moved, then having initially arbitrary symbols or 
directives associated with the movement, might be done in the situation of 
actual repair, or in trial situations. A very adept helper would presumably 
build up a repertoire of motor-sensory understanding of such activities, 
given sufficient cognitive capability and memory. 

The “showing" Is not enough. The motor activity must be related to 
meaningful signals that can be communicated In the situations of repair. 
These signals may themselves be distal (e.g., spoken) rather than motor. 

Other applications. Examples given above are meant to suggest 
potential embedding of language behavior, in the broad sense, In human- 

machine enterprises. Analysis of such situations must Include, we would 
argue 

• detailed analysis of what Is to be done, 

• explicit analysis of communications patterns (who and what will be 
involved in the communication), 

• linguistic and semiotic analysis, both to suggest possibilities for 
communication, and to keep the means of communication manageable. 
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IV. Dynamic Communication Systems: 
Message-Passing In Object-Oriented Languages 17 


1. Introduction 

We now proceed to an examination of object-oriented computation 
systems. Object-oriented systems are Important to the question of action- 
related computation because their structure provides a partial model of 
external action systems. That Is, certain computational entitles, the 
objects, pass messages to the end of getting computation done. But there 
are differences between a strictly computational system, and a real 
machine/environment system. 

In typical software systems, communication among system elements Is 
well defined. In fact, defining the methods of communication between 
system components is a major part of traditional system design. In these 
cases, communication depends on static definitions. The problem Is 
statically defined, as are the courses of Interaction and the globally 
available data. However, ?r the system is essentially dynamic, with 
autonomous components of varying types and numbers entering and leaving 
the system, this type of system definition Is Inadequate. For example, 
consider a collection of robots permanently maintaining an outpost with 
limited human supervision. Such a system must tackle problems never 
envisioned by its designers, must dynamically organize itself to respond to 
novel problems, and must rely on explicit communication for shared 
Information. 


17 The bod/ of this section was written by Mr. Gordon Streeter. 
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The complete dependency of such systems on direct communication, 
rather than shared data or shared design, places heavy constraints on the 
unit of communication: the message. Each message must accurately Identify 
Its receiver, provide complete Information as to Its content, and cannot rely 
on any statically defined Information about the sender or the receiver. In 
addition, the message must be a reliable means of communication. 

Provisions must be made for accurate transmission, comprehension, and 
execution of each message. 

2. Scope 

The following simple Illustration Is Indicative of the kind of systems 
under consideration: 

Robot A Is one of a contingent of robots at work on a remote site 
which has little human supervision. A has the task of collecting debris from 
a construction site. A encounters a rock which Is too heavy for It to lift 
alone. A needs help from some robot X. A sends the following messages In 
order to accomplish this: 

X, come here. 

X, lift end of rock. 

X, carry rock to transport. 

X, put rock In transport 

The problems associated with Implementing a system of this type are 
numerous and cover a wide range of technologies. The Implementation of a 
single robot of this nature Is beyond the capability of current hardware and 
software technologies. The combination of these robots Into a dynamic 
system Introduces new problems of communication, priority-setting, and 
coordination. The current discussion concerns a fundamental aspect of 
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communication, that of message-passing. As such it will assume that the 
communicating components share a common language and that a physical 
layer supporting communications Is present. In addition, the discussion will 
be limited to simple request-response communication, and will Ignore the 
detail of any Implied dialogues. 

A three-element model serves for discussion of request-response 
exchanges. The three elements are: sender, receiver, and message. The roles 
of each element are evident from their names. A fourth element, dispatcher, 
will be added later. The following paragraphs use this three-element model 
for describing some of the problems Involved In communication between 
dynamic systems of autonomous components. 

There are several areas In which problems could arise in the above 
example. To begin with, a robot X must be Identified In some way. Once 
Identified, the robot may be unable to comply, either because It Is Immobile, 
or otherwise occupied. These problems could be determined before X 
actually enters the task by some pre-task discussion which Irons out all 
that will be required. Other failures, however, could occur during the 
processing of the task. For example, X could experience an Internal fault 
while carrying the rock to the transport, or could have a priority request 
from some other area of the site. None of these problems can be statically 
handled, since they can not be anticipated at design time. 

3..0bject-0riented Languages 

There Is class of languages, called object-oriented languages (Saunders, 
1989; Stroustrup, 1988), which support the request-response model 
described above. These languages are based on a design philosophy of 
completely encapsulated objects which request actions of each other by 
sending messages to each other. This design has four components: 
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Sender 
Receiver - 
Message - 
Dispatcher 18 - 


the originator of the request 

the target of the request 

the packet containing the request 

the mechanism for transmitting the message 


Two languages, Smalltalk and Lisp Flavors, will be used for Illustration. 
The two are fundamentally different In approach, but each Implement full- 
featured object-oriented programming systems. The following paragraphs 
provide a brief Introduction to object-oriented programming as well as to 
Smalltalk and Lisp Flavors. 


Briefly stated, the process of software development In object-oriented 
languages Is the creation of abstract data types (Ladd, 1989; Bailey, 1989). 
These types describe both the format of the data and the operations to be 
performed on the data. These are called "classes". Any given object Is an 
’Instance' of Its class. Class Information Is not available outside the class, 
and Instance-specific Information Is not available outside the Instance. The 
only way objects can Interact Is through message-passing. Message-passing 
Is conceptually similar to, but fundamentally different from function 
Invocation. With function calls, the caller accesses the target directly. 
Messages are sent via a message dispatcher, which Identifies the actual 
code to be executed. This separation Is Important for simulating the kinds of 
autonomous systems discussed above. 

Smalltalk (Goldberg and Robson, 1983; Saunders, 1984) Is a complete 
object-oriented programming environment, originating from Xerox PARC, and 

18 Some definitions of object-oriented languages Include languages which have encapsulation, but 
no message- passing. See, for example, Winston and Horn ( 1 984) and Stroustrup ( 1 988), These 
languages typically use function calls, rather than mesages. Ada, for example, would be Included 
In such a definition. 
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closely tied with direct manipulation, mouse-menu Interfaces. The system 
Is based on a simple, single paradigm wherein every entity Is an object, and 
objects Interact via messages. The syntax of the language reflects this 
paradigm and has the general form of an object's name followed by a 
message to be sent to the object. The message may contain other objects as 
arguments. In the example below, an object of type 'List' Is created, several 
strings are added to the list, the list Is asked to sort itself, and the result 
of the sort Is asked to print Itself. 

I aLlst I 

aLlst :* List new. 
aLlst add: 'first string'. 
aLlst add: 'second string'. 
aLlst add: 'last string'. 
aLlst sort print. 

Lisp Flavors (Coral, 1987; Saunders, 1989) Is an extension to Lisp, 
originating from a Joint MIT/Symbolics effort. It Is available In several of 
the Lisp dialects, Including Symbolics Lisp and Allegro Common Lisp. 
Flavors inherits Its syntax from Lisp, and in the Lisp tradition, gets Its 
power from the complexity of Its Implementation, having many more 
options, modes, and parameters than Smalltalk. The terminology Is 
somewhat different from Smalltalk as well. For example, Flavors objects 
are operated upon by "generic functions", rather than by "message-passing". 
While there are subtle differences In generic functions and messages- 
passlng, to a large extent this Is merely a difference In terminology, born 
out of the very different approaches of Smalltalk and Flavors. Flavors does 
employ a dispatcher to transmit messages, but since Lisp Is a "functional 
programming language," this dispatcher Is said to provide generic 
"functions". The following Flavors example (though not excellent Lisp) 
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performs the same function as the Smalltalk example above. 

(prog (a-list) 

(setq a-llst (make-instance ’list)) 

(send a-llst :add 'first-string') 

(send a-llst :add 'second-string) 

(send a-llst :add ’last-string) 

(send (send a-llst :sort) :pr1nt)) 

The rock-carrying example above can be written In Smalltalk as: 

X comeHere. 

X HftEndOf: rock. 

X carry: rock to: Transport. 

X out: rock In: Transport. 19 

In Flavors: 

(prog 0 

(send x :come-here) 

(send x :1 ift-end-of rock) 

(send x :carry-to transport rock) 

(send x :put-1n transport rock)) 

4. Using Existing Implementations 

While object-oriented languages provide a good platform for simulating 
the dependency of dynamic systems on explicit communication, they do not 

19 Note that capitalization Is us8d In Smalltalk for two purposes. The first is to separate words 
In multi-word symbols. The second is to indicate the scope opf a symbol. Global symbols begin 
with a capital letter; local symbols do not. In this example, X and Transport are assumed to be 
global symbols, which rock Is a local symbol representing the rock In question. 
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Inherently provide for the kinds of problems found In dynamic systems with 
autonomous components. The following paragraphs describe possible 
methods of coping with these problems using Smalltalk and Flavors. 

The first problem, that of Identifying a possible receiver, Is easily 
solved (or at least hidden) by placing the burden on the underlying 
communication software. The remaining discussion assumes that some 
lower level of software maintains a globally-avallable list of active 
communicants. 

The problem remains, however, of discovering whether the Intended 
receiver can respond to the message. One possibility is to keep a type entry 
In the list of active communicants. Each sender could then contain a 
database of the capabilities of receivers of each type. Before sending a 
message, the receiver would then have the responsibility to check the 
capabilities of each of the possible receivers until It found one which could 
respond to the request. 

There are two problems with this approach. The first is that it places a 
heavy burden on the sender, requiring It to be aware of every capability of 
every possible type of receiver. If the number of different types of 
receivers were large, storing and accessing the database could 
unnecessarily complicate some simple components. This would be an even 
greater problem If the sender were a human. In a large system, the human 
could not be expected to Internalize the database, but would have to rely on 
external, probably automated, storage. 

The second problem Is that the solution Is most naturally a static one, In 
which the list of capabilities Is created at implementation time, the 
solution does not lend Itself well to systems In which the types of 
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participants are changing, or In which the capabilities of a single type may 
change over time. 

The more natural solution Is to have each component provide Its 
capabilities on request. This would enable the sender to test candidate 
receivers by Inquiring of each If It could comply to a given request If such a 
request were Issued. Both Smalltalk and Flavors provide such capabilities. 
Smalltalk objects can be Interrogated In this manner via the message 
“respondsTo:". For example, the message: 

X respondsTo: *comeHere 

would return true If X could comply, false If X could not. Flavors provides 
the message: M :operat1on-handled-p“, which performs the same function. 20 
Flavors supports a similar message, ":send-1f-handles B . This message is 
sent with another message as Its argument. The receiver sends the argument 
message to itself If It determines that It can handle it. However, B :send-1f- 
handles” provides no feedback as to whether the argument message was 
actually sent. 

Using this method, the sender could select an appropriate receiver from a 
list of candidates and send a message to It. This could be Implemented In 
Flavors something like: 

(send (send candidates .respondlng-to *:come-here) 

:come-here) 

Even In this compressed form, with the M respond1ng-to B method doing the 

20 Note that both “respondsTo:” and “operation-handled-p” Indicate whether the object 
responds to a message of the given name. No semantics Is Implied. For example, integer objects 
and list objects both respond to the message “add: ”, but the message has different meanings to each 
type. 
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work of searching out an appropriate receiver, the process Is clumsy. Also, 
It does not allow for the condition when no receiver Is able to respond. 

Another extreme would be to force the receiver to respond to all 
requests. Through a process which might be called "smart-reception", the 
receiver must accept all messages and acquire the expertise to handle them 
appropriately. There Is a single point in both Smalltalk and Flavors at which 
such an action could take place. In Smalltalk, when an object Is sent a 
message for which the dispatcher can find no response, the dispatcher sends 
the object the message: "doesNotUnderstand:" with the original message as 
Its argument. The Flavors dispatcher reacts similarly, using a message 
called: ":uncla1med-message". In addition, Flavors provides the ability to 
supply a ":default-handler" which, If present, is used as the handler for 
messages for which no explicit handler can be found. 

Having this capability, however, Is a long way from solving the problem 
of smart reception. The receiver may simply not have the information or the 
hardware required to solve the problem. For example, If a one-armed robot 
Is sent the message: "hang-wal 1-paper", the message will most likely end up 
In the default message handler. Even If the robot could correctly Interpret 
the message, it could not respond without changing Its "physiology". 

Though not practical on a large scale, some degree of smart reception Is 
essential to handle small discrepancies. For example, It is likely that a 
robot equipped collect samples from the ground could physically respond to 
a request to dig a small hole, even though It was not specifically designed 
to do so. The sender could not be expected to detect this ability; only the 
receiver has the knowledge required to do so. 

Neither of these approaches deal with the condition In which the receiver 
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attempts to respond and then falls to do so. This situation could arise when 
the receiver experiences a malfunction, or when the task Itself changes In 
some unexpected way which Invalidates the current task description and 
forces the receiver to request more Information. In both conditions, the 
receiver must notify the sender of the difficulty. Unfortunately, neither 
Smalltalk not Flavors provides the receiver with the Identity of the sender. 
Both languages provide the variable "self", which Is the Identity of the 
currently acting object, but neither support the concept of "sender". 

This problem could be solved by a programming convention which forces 
the Identity of the sender to be sent with every message. In Smalltalk, this 
convention, combined with the receiver selection process described above 
might look like: 

(Candidates respondlngTo: *comeHere)comeHereW1thSender: self 

5. Extending the Dispatcher 

Message-passing which follows these conventions Is much more complex 
than the simple messages described above. This overhead complicates the 
coding process to an unacceptable degree. Fortunately, these two functions 
can be delegated to the dispatcher, relieving the sender of such a burden. 

Moving this work to the dispatcher makes sense for two reasons. The 
first Is reducing code bulk and complexity. If every message requires that 
the actual receiver be selected from a list of candidates, then the function 
can be Inserted once, In the dispatcher, rather than many times In each 
sender. The second reason Is that the dispatcher knows the Identity of both 
the sender and the receiver, and thus can provide the receiver with the 
Identity of the sender. 
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To accomplish this means to change the dispatcher. In Smalltalk, this Is 
not an easy task, because the dispatcher is part of the "byte-coded" 
interpreter, and source is not available for it. Flavors does not have such a 
restriction. However, the Flavors code for the dispatcher is quite complex, 
so the following simple example, taken from Winston and Horn, 1984 (pg. 
245), will be used for Illustration. 21 

(defun send-message (target method &rest arguments) 

(apply (get (get target Ms-a) method) 

(cons target arguments))) 

The example corresponds closely to the Flavors message-passing shown 
in previous examples using "send". The terminology Is different, however: 
"target" Is used for "receiver", and "method" Is used for the message name. 
The example assumes that the property list of the receiver's type (accessed 
through "1s-a") contains the code to Implement the message, filed under the 
name of the message. 

The first step in expanding on this example Is to provide the receiver 
with the identity of the sender. The dispatcher can accomplish this by 
providing "self" to the receiver under the name “sender", as follows: 

(defun new-send (receiver message &rest arguments) 

(apply (get (get receiver ’is-a) method) 

(cons self (cons receiver arguments)))) 

This allows the “come-here" code of some robot X to be written as: 

(defun come-here (sender self) 

21 Winston and HOrn ( 1 984) also present a more complex example, supporting the concept of 
“befores” and "afters" , which is somewhat close to an actual Flavors implementation. 
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(new-send self :go (new-send sender :where-are-you))) 

The second step Is to provide the new sender with the ability to search a 
list of candidates and send the message to the first acceptable candidate. 
This task Is performed by a helping function: 

(defun send-help (rec-llst message) 

(cond ((null rec-llst) 

(get (get self Ms-a) 'Tailed)) 

((get (get (car rec-llst) ’1s-a) message)) 

(t (send-help (cdr rec-llst) message)))) 

(defun new-send (receiver message &rest arguments) 

(apply (cond ((atom receiver) 

(get (get receiver Ms-a) message)) 

(t (send-help receiver))) 

(cons self (cons receiver arguments)))) 

With this dispatcher, the receiver may be specified as a single object, or 
as a list of objects. If a single object Is provided, the message Is sent to It 
directly. If a list Is provided, the list Is searched for an object which can 
respond. The first such object Is used as the receiver. If no receiver Is 
found, the sender Is sent the message “Tailed". This technique allows A to 
send the message ":come-here" to an unknown receiver, as shown below. 

(new-send candidates :come-here) 
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6. Conclusion 


Dynamic systems pose many special communication problems. While 
object-oriented systems provide a means of emulating the way such 
systems must communicate, they do not Intrinsically solve those special 
problems. The technique described above solves the problems of Identifying 
receivers and making the Identity of the sender available to the receiver. 
But this technique Is useful only for the simplest of problems, and must be 
expanded to be useful In tasks which require ongoing dialogues. In addition, 
techniques need to be developed to support "smart reception" of messages. 
However, none of these techniques will prevent the complete failure of all 
possible receivers to respond to a message. This responsibility must rest 
with the sender of the message. 
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V. Conclusions and Issues 


Conclusions 

This report has discussed dimensions of action languages for 
communication between humans and machines, and examined In some detail 
the message-handling capabilities of object-oriented programming systems. 

Design of action languages Is seen to be very contextual. Economical 
and effective design will depend on features of situations, the tasks 
Intended to be accomplished, and the nature of the devices themselves. 

Current object-oriented systems turn out to have fairly simple and 
straightforward message-handling facilities, which In themselves do little 
to buffer action or even In some cases to handle competing messages. Even 
so, It is possible to program a certain amount of discretion about how they 
react to messages. Such 'thoughtfulness' and perhaps relative autonomy of 
program modules seems prerequisite to future systems to handle complex 
Interactions In changing situations. 

Issues 

Description and understanding of what Is In situations, and what may 
suddenly happen within them, emerges as critical for the development of 
language-mediated communication about action. 

Description Is problematic, understanding by machines Is difficult 22 , 
and work on Incorporating situational features and events within language 
systems Is not new but Is still hardly a major pursuit of linguists 23 

22 Sometimes, too, by humans. 
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Accounting for the unexpected In real situations Is part of the capability 
of any organism, but Is not well handled In computational systems, perhaps 
because of their necessity for specifying everything exactly for computing 
machines as we are familiar with them. 

In robotics, there has been a schism for several years between Al 
researchers who wish to plan everything In some detail, and those who feel 
that planning requires needlessly complex and perhaps Inadequate response 
to actual situations. This controversy Is not especially relevant to the 
manufacturing applications Involving repeated operations on fixed parts, but 
It becomes Important rapidly when dealing with ambulatory robots. 

Further analysis of action language would Involve, as has been discussed 
above, more details of just how Information changes, and how surprises 
come about, to be accounted for or Ignored, during the course of action. 

Action systems should be compliant If we build them, but have to be 
autonomous, at the very least In order not to occupy our attention unduly. 
Autonomy may be hazardous, though. It Is not clear that technology planners 
have adequately faced this Issue. 

Various linguistic Issues bear on the design of restricted action 
languages. 

One design Issue Is just how complete the language design should be. 

That Is, we know that In the case of human languages, some parts of them 
change to meet new situations, or even because human cultural systems 
seem to maintain a balance of persistence and modification. 

If humans are Involved In the machine communications, they may feel a 
need to modify the language In some ways. Perhaps only vocabulary could be 
added or changed. This could be a problem since other users might not be up 
with the latest vocabulary. 

23 The most developed treatment of situational factors In linguistics and logic Is In Barwlse- 
Perry situational logic. But it is only one possible approach. 
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Suppose, though, that the language could not change at all. Then special 
references to unique situations might not be easy to express. Further, 
exchanges Involving any kind of abstraction or convenient generality (or 
even vagueness) might also be difficult. 

The planned versus evolutionary dimension of language planning Is 
reminiscent of the controversy among Al researchers In robotics. Perhaps It 
is true that a static language will always be Inadequate, but setting bounds 
on variation may be needed In some cases, especially with machines which 
have meager cognitive capabilities. 

What kind of language to use provides many linguistic questions. Since 
humans will be communicating some times, they could feel more 
comfortable If features of human languages were incorporated into the 
human-device communication system. But what features, and from what 
languages? 

A given language, say English, has many structural features . 24 Surveys 
of other languages show some of the same, and some different ways of 
putting verbal signs together . 25 Particularly Interesting are those 
languages that have been Influenced by a number of sources, or that serve as 
trade languages 26 

Since human language processing by machine Is difficult, It may be that 
more graphic “languages" such as schematized pictures, perhaps augmented 
by sounds, are most promising to pursue, at least for some tasks. 

24 See, for example, the discussion In Huddleston’s Introduction to the Grammar of English 

( 1 984), which treats familiar phenomena of English In theoretical and structural terms, at a 
very fine level of analysis. 

25 One discussion Involving examples from many languages is Halman ( 1 985). Grammars and 
tutorials of various languages provide ready Information, also. 

26 Such as Swahili. Languages of Islands where trade has been Important are sometimes 
relatively simple syntactically and are thought to be easy to learn. Hawaiian, Indonesian come to 
mind. English Is now, of course, very widely spoken. But, any human language seems to have its 
own peculiarities, Its own complexities, and of course, Its own adherents. 
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Communicating with an ambulatory robot would probably be well handled 
with a picture language, at least in part. 

Another possibility, useful perhaps for languages where query Is more 
Important than depiction, Is to take a well-proven notion In the analysis of 
human language such as that of case relations 27 , then to restrict syntactic 
possibilities. 

So the action language concept raises many possibilities for realization 
and many research Issues. The history of computation over the past decade 
or so has shown that models for computation often follow closely available 
machines. Actor and agent computing models, which are more restricted 
than their names would suggest, 28 are just about what one would need to 
reflect computation using multiple processors working on the same 
problem, with serial communication In networks. As devices become 
available that are autonomous but connected, It seems likely that 
computational means will be modified. But history also shows that this 
trend is sometimes sluggish, so that there Is often a tendency to use older 
models with machines that have more challenging and complex tasks. The 
analysis offered In this research report Is aimed at counteracting that 
trend, and facing Issues of optimal language and computation design based 
on an examination of the situations of use. 

Daniel 6. Hays, Gordon Streeter 

The University of Aiabama in Huntsviiie 

Spring/Summer i989 

27 Fillmore called the attention of linguists to the case notion very persuasively some time ago 

( 1 968). In computation, Roger Schank has made good use of case assignments.of natural language 
terms from his early career (Schank and Abelson, 1977).. An interesting recent presentation of 
case- like information in lexical organization is by Judith Markowitz ( 1 988). John Sowa’s work 
In propositional calculus models, or conceptual graphs, continues and extends the notion ( 1 984). 

28 See the comments in Tello ( 1 989) for a succinct description of the capabilities. Agha’s book 
( 1 986) also contains thorough discussion of this kind of model. 
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